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A linear program consists of linear constraints with the goal of maximizing or minimizing 
a linear objective function subject to the constraints. 

Lets look at the max-flow problem: 

G = {V,E) 

In this problem the capacities and the flows The conditions a flow must 

satisfy are: 

^Xi3=^X3i VuGF\{s,i} 
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Note that all of our constraints are linear as they are of the form: 
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aiXi + 023^2 + ■ ■ ■ + anXn S 

We would like to find the maximum of Xgj — Xjg- 

Let's look at a minimum cost flow problem. The constraints are: 

j j 

The objective function is: 

i,jeE 

The goal is to minimize the objective function. 

A maximum matching problem would have the following constraints: 
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The general form of a linear program is: 

fx, \ 
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Max c X = CiXi or Min c x = Max — c x 

2 = 1 

Ax < h, a; > a^x > b —aFx < —h 



To solve: 

max cxAx < b 

we can set x = y — z, where y,z > 0. 
(Note: a^x > b <^ -a^ < b) 

We are trying to find an x such that the objective function is maximized. We must ask 
ourselves if there is a good characterization for the solution. Suppose we are given x* . Is 
X* the optimal solution? 

If NO: Either x* does not satisfy some constraint or give x** such that 

c^x** > c^x*. 
If YES: ?? (We'll come back to this later) 

Here is another example: Find the maximum value of (4a;i + X2 + ^x^ + 30:4), call it z*, 
subject to the following constraints: 



Xi — X2 — X2 + 3Xyi < 1 

5xi + X2 + -ixz + 8x4 < 55 

—xi + 2x2 + 3a;3 — 5x4 < 3 

Xi,X2,X3,X4 > 

Let's try to estimate z* with a hit and miss method: 

a; = (0,0, 1,0) z*>5 
1, 
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The problem with this method is that we don't know when z* is a maximum. We need to 
find an upper bound on the optimum. 



Let's try another approach: Equation 2 multipUed by | is 

25 5 40 275 

—XI + -X2 + 5a;3 + ya;4 < — . 

Notice that the left side of this equation is term-by-term greater than or equal to the 
objective function. Therefore, 

275 

4a;i +X2 + 5a;3 + 2xi < ——. 

And therefore, 

* / 275 

- 3 

An even stricter bound can be obtained by adding Equations 2 and 3. This gives, 

Axi + ix2 + 60:3 + 3a;4 < 58. 
Again, this is term-by-term greater than or equal to the objective function, so, 

z* < 58. 



Let us generalize this approach. Choose yi , ?/2 , ?/3 > to be three multipliers on Equations 
1, 2, and 3. Taking the sum we get: 



(yi + 5?/2 - y-i)xi + {-yi + y2 + '^y3)x2 + {-yi + 3?/2 + ^3)x3 + 
+ {3yi + 8y2 - 5y-i)x4 > yi + 55y2 + 3y3- 



(5) 



In order for the left hand side of Equation 5 to be an upper bound on the objective function 
we require: 

yi + 5y2 - y3 > 4 
-2/1 + 2/2 + 2y3 > 1 
-2/1 + 3y2 + 32/3 > 5 
3?/i + 8y2 - 52/3 > 3 
2/1, 2/2, ya > 

Therefore, in order to get the best upper bound we should minimize (yi + 55y2 + 3y3) 
according to the above constraints. This constitutes a new linear program. 



< yi + 55y2 + 3y3 
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In general: 



max c^x 
Ax<h 

Xi>{) y i 



max CiXi + C2X2 + . . . + CnXn 
auXi + ai2X2 + . . . + ainXn < bi 
a2\X\ + a22X2 + . . . + a2nXn < ^2 



am\X\ + am2X2 + • • • + amnXn < i>m 

Again, we would choose multipliers yi,y2, ■ ■ ■ ,ym > on the m constraint equations above. 



The dual is: 



Summarizing, 



min biXi + b2X2 + . . . + brnVm 
auUl + 0.21112 + ■ ■ ■ + amlUm > Cl 
ai2?/l + a22?/2 + ■ ■ ■ + am2ym > C2 

ainVl + a2ny2 + ■ ■ ■ + amnVm > Cn 

yi>o v« 



max c^x 
Ax<b 
x>0 

^ V ' 

Primal 



(Note: Dual(Dual) = Primal) 



min b^y 

A^y > c 

y>o 

■ s/ ' 

Dual 



Also, 
therefore. 



max c^x < min b^y, 



(Fx < {A'^y)^x = y^Ax < y^b = b^y 
=^ c^x < b^y. 
This gives us the Weak Duality Theorem: 

max {c^x I Ax <b}< min {y^b / AJ^y = c, y > 0} 



(6) 



Next week we will prove the Strong Duality Theorem which replaces the inequality in Equa- 
tion 6 with an equality. Using this we will be able to give a short proof of the case when 
X* is optimal (i.e. the YES case mentioned earlier), which means that we have good char- 
acterization. 
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